Web Survey Bibliography
Based on our experience in the mixed-mode (CATI-CAWI) field, we perceived a difference in the length of interview (LOI) between these two modes: CAWI interviews are always briefer than CATI's. Validating this work hypotesis we tried to find out which questions show the greater gap and why. Another aspect that we've investigated is the link between LOI and some socio-demographic variables. With CAWI interviews, we've tried to validate the existance of a link between LOI and the number of questionnaires completed by panelists in the past . We've also tried to estimate CAWI's LOI using CATI's LOI as input and viceversa.
Methods & Data:
To carry out these analysis we've used both metadata, such as LOI and sinlge page completion time, and socio-demographic respondent's characteristics. Those data come from two mixed-mode CATI/CAWI surveys. In both cases we've used an online panel (Opinione.net) as CAWI framework, whereas CATI interviews were collected through a non-probabilistic quota sample design (geographically and demographically representative of Italian population). The first dataset has 1600 CATI interviews and 1020 CAWI interviews, the second one is composed by 752 CATI and 294 CAWI questionnaires respectively.
Results:
As we expected LOI for the CAWI interviews is shorter than the LOI for the CATI interviews (t-test: p-value = 0). Both datasets confirm this work hypotesis. The difference increases when taking into account matrix question type (significative p-value).
Correlation between LOI and socio-demographic variables is stronger in the CATI interviews than in the CAWI. In the former case Pearson's correlation index between LOI and the birth year is statistically significative for both datasets (p-value=0). In the latter case the correlation index is lower and statistically significative only in the first dataset.
We didn't find any correlation between the LOI and the habit of completing questionnaires in the CAWI subsets (ranking+# invitations) (correlation index = -0.014, p-value=0.63).
Using the first dataset we've created a model for estimating the CATI LOI/CAWI LOI ratio. Applying this model to estimate second dataset's ratio, we've obtained a good result (estimated ratio: 1.46; real ratio: 1.5).
GOR Homepage (abstract) / (presentation)
Web survey bibliography - 2014 (234)
- Undisclosed Privacy: The Effect of Privacy Rights Design on Response Rates; 2014; Haer, R., Meidert, N.
- Modelling ”don’t know” responses in rating scales; 2014; Manisera, M., Zuccolotto, P.
- Does Gamification Work? - A Literature Review of Empirical Studies on Gamification ; 2014; Hamari, J., Koivisto, J., Sarsa, H.
- Clicking vs. Dragging: Different Uses of the Mouse and Their Implications for Online Surveys; 2014; Sikkel, D., Steenbergen, R., Gras, S.
- The Effect of Benefit Wording on Consent to Link Survey and Administrative Records in a Web Survey; 2014; Sakshaug, J. W., Kreuter, F.
- Completion rates and non-response error in online surveys: Comparing sweepstakes and pre-paid cash incentives...; 2014; LaRose, R., Tsai, H. S.
- The accuracy of self-reported medical history: A preliminary analysis of the promise of internet-based...; 2014; Kelstrup, A. M., Juillerat, P., Korzenik, J.
- Panel Attrition - Separating Stayers, Fast Attriters, Gradual Attriters, and Lurkers; 2014; Lugtig, P. J.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- The use of within-subject experiments for estimating measurement effects in mixed-mode surveys ; 2014; Klausch, L. T., Schouten, B., Hox, J.
- Improving the Representativeness of Online Surveys ; 2014; Henning, J.
- GESIS Panel: Sample and Recruitment; 2014
- Online Surveys as a Management Tool for Monitoring Multicultual Virtual Team Processes; 2014; Scovotti, C.
- How much is shorter CAWI questionnaire VS CATI questionnaire?; 2014; Bartoli, B.
- WEBDATANET: A Network on Web-based Data Collection, Methodological Challenges, Solutions, and Implementation...; 2014; Tijdens, K. G., Steinmetz, S., de Pedraza, P., Serrano, F.
- The Use of Paradata to Predict Future Cooperation in a Panel Study; 2014; Funke, F., Goeritz, A.
- Incentives on demand in a probability-based online panel: redemption and the choice between pay-out...; 2014; Schaurer, I., Struminskaya, B., Kaczmirek, L.
- The Effect of De-Contextualisation - A Comparison of Response Behaviour in Self-Administered Surveys; 2014; Wetzelhuetter, D.
- Responsive designed web surveys; 2014; Dreyer, M., Reich, M., Schwarzkopf, K.
- Extra incentives for extra efforts – impact of incentives for burdensome tasks within an incentivized...; 2014; Schreier, J. H., Biethahn, N., Drewes, F.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- Device Effects: How different screen sizes affect answer quality in online questionnaires; 2014; Fischer, B., Bernet, F.
- Moving towards mobile ready web panels; 2014; Wijnant, A., de Bruijne, M.
- Innovation for television research - online surveys via HbbTV. A new technology with fantastic opportunities...; 2014; Herche, J., Adler, M.
- Mixed-devices in a probability based panel survey. Effects on survey measurement error; 2014; Toepoel, V., Lugtig, P. J.
- Online mobile surveys in Italy: coverage and other methodological challenges; 2014; Poggio, T.
- Distress Tolerance as a Predictor of Risky and Aggressive Driving; 2014; Beck, K. H., Ali, B., Daughters, S. B.
- African-American breast cancer survivors’ preferences for various types of physical activity interventions...; 2014; Paxton, R., Nayak, P., Taylor, W., Chang, S., Courneya, K., Schover, L., Hodges, K., Jones, L.
- Measuring well-being: An analysis of different response scales; 2014; van Beuningen, J., van der Houwen, K., Moonen, L.
- The impact of contact effort and interviewer performance on mode-specific nonresponse and measurement...; 2014; Schouten, B., Cobben, F., van der Laan, J., Arends, J.
- Topic sensitivity and research design: effects on internet survey respondents' motives; 2014; Albaum, G., Roster, C. A., Smith, S. M.
- Improving Survey Methods: Lessons from Recent Research; 2014; Engel, U., Jann, B., Lynn, P., Scherpenzeel, A., Sturgis, P.
- Picking up the Bread Crumbs: Holistic Insights from Social Media; 2014; Souda, P.
- Beauty is more than screen deep: Improving the web survey respondent experience through socially-present...; 2014; Casey, T. W., Poropat, A.